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In this paper we study operator-type models of dynamic nonlinear 
physical systems, such as communication channels and control sys- 
tems. Attention is focused on the problem of determining conditions 
under which there exists a power- series- like expansion, or a polyno- 
mial-type approximation, for a system's outputs in terms of its inputs. 
Related problems concerning properties of the expansions are also 
considered and nonlocal, as well as local, results are given. In 
particular, we show for the first time the existence of a locally 
convergent Volterra- series representation for the input-output rela- 
tion of an important large class of nonlinear systems containing an 
arbitrary finite number of nonlinear elements. 

I. INTRODUCTION 

In this paper we study operator-type models of dynamic nonlinear 
physical systems, such as communication channels and control sys- 
tems. Attention is focused on the problem of determining conditions 
under which there exists a power-series-like expansion, or a polyno- 
mial-type approximation, for a system's outputs in terms of its inputs. 
Related problems concerning properties of the expansions are also 
considered and nonlocal, as well as local, results are presented. In 
particular, we show for the first time the existence of a locally conver- 
gent Volterra-series representation for the input-output relation of an 
important large class of nonlinear systems containing an arbitrary 
finite number of nonlinear elements. 

With regard to background material, functional power series of the 
form 



* The material given in this paper was described in the writer's "Conference Course" 
at the 1981 European Conference on Circuit Theory and Design, The Hague, August 
1981. 
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ko+ £ •'• k m (t, Ti, •••,T m )u(Ti) ••• U(T m )rfT! ••• rfT m , (0) 

in which k is a constant, J is a parameter, and u and the £ m for m > 1 
are continuous functions, were considered in 1887 by Vito Volterra 1, 
in connection with his studies of functions of functions. (These studies 
provided much of the initial motivation to develop the field now known 
as functional analysis.) About twenty years later, Frechet 3 proved that 
a continuous real functional (i.e., a continuous real scalar- valued map) 
defined on a compact set of real continuous functions on [a, b] could 
be approximated by a sum of a finite number of terms in Volterra's 
series (0), but with (in analogy with the well-known Weierstrass 
approximation theorem) the number of terms, as well as the k m , 
dependent on the degree of approximation. 

It was Norbert Wiener 4 who first used a Volterra-series representa- 
tion in the analysis of a nonlinear system.* The form of Volterra's 
expansion provided also the basis for Wiener's later work (see, for 
example, Refs. 5 and 6) on nonlinear analysis and synthesis. His 
studies, which were concerned mainly with the modeling of systems 
when only input-output data (rather than the system's equations) are 
available, stimulated considerable interest concerning Volterra and 
other + functional expansions for nonlinear systems. It was appreciated 
from the outset that such expansions, when they exist, could provide 
important insight of a qualitative nature concerning the input-output 
behavior of a system, and that they could be useful in connection with, 
for example, the estimation and/or equalization of distortion caused 
by nonlinearities. 

There is a fairly large literature related directly or indirectly to the 
material of the present paper (see, for example, Refs. 1 through 29 and 
the references cited there). In most cases the functional expressions 
considered are Volterra series (or truncated Volterra series). With 
regard to systems for which the governing equations are known, with 
relatively few exceptions, questions concerning the existence of an 
expansion, its convergence, and/or the nature of the approximation 
provided by a truncated series are either not addressed or are left 
unanswered. (See, for instance, the remarks in Ref. 6, p. 137, on the 
lack of understanding concerning convergence.) 

On the other hand, some material regarding the range of validity 
and specific properties of functional expansions has appeared, both for 
systems governed by ordinary differential equations defined on a finite 
time interval [0, t] (Refs. 15, 16, 20, and 23 are representative refer- 



* In Ref. 4 Wiener considers the problem of evaluating the output moments of a 
gpecific type of detector circuit driven by a random input. 

* See, for instance, Ref. 7. 
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ences), and for polynomic systems, which are modeled by operator 
generalizations of ordinary functions of polynomial form. 26 " 29 The work 
on differential equations is concerned mainly with the particular case 
of bilinear systems and with "linear-analytic" systems. 16,23 The main 
result obtained asserts that under certain conditions (see, for example, 
Ref. 23) there does exist a locally convergent Volterra series for the 
solution (but with the size of the region of convergence dependent 
on t). 

The studies of polynomic systems, which are operator theoretic in 
nature and which draw on the theory of multilinear forms, are more 
closely related to the results reported in this paper. The most pertinent 
earlier proposition 29 is one to the effect that if a certain contraction 
mapping condition is met, then it is possible to construct in a particular 
way a local inverse of a certain generalized power series. While we do 
not use previous results in the polynomic systems area, there are some 
points of contact with the earlier material, and this is discussed at 
appropriate places in Section II. 

We now briefly outline the remainder of the paper. Section II begins 
with some mathematical preliminaries. In Section 2.1, we introduce 
the general setting of concern throughout the rest of Section II. This 
involves two maps /"and g related by f[g(u)] = u for u in a certain set 
that can be thought of as a set of system inputs such that each u 
contained produces an output g(u). The remaining portion of Section 
II describes, proves, and discusses results concerning expansions and 
approximations of g(u). The material in Section II is somewhat ab- 
stract. Examples which illustrate how the material can be used to 
obtain more specific results of general interest are given in Section III. 

II. APPROXIMATIONS AND EXPANSIONS 

Throughout the paper, 38 and 38 denote two Banach spaces, each 
with real or complex scalars, and X denotes a nonempty open subset 
of 38o. We use the symbol || • || for the norm associated with 38, as well 
as for the norm associated with 38 , and 9 is used to denote the zero 
element of 38 and of 38q. 

It will become clear shortly that a central role in our development 
is played by first and higher order Frechet derivatives (see, for instance, 
Ref. 30). Before proceeding, we recall a few pertinent facts and defi- 
nitions. 

Let F map X into 38, and let x be a point in X. If there is a bounded 
linear map L Xo from 38 to 38 such that ||F(xo + h) — F(xq) — Lxjh\\ = 
o(||/i||) as || h || —> 0, then F is said to be Frechet differentiable at xq 
with Frechet derivative L Xo , which we denote by dF(xo). If F is Frechet 
differentiable at every point in X, then we say that F is differentiable 
on X. Similarly, if F is Frechet differentiable on X and dF(-) is 
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continuous, then F is said to be continuously differentiable on X. 
Higher order Frechet derivatives of Fare defined in the usual inductive 
manner. 

Note that the second-order Frechet derivative d 2 F(x ), when it 
exists, is a bounded linear map from 38 into the space L(38 , 38) of 
bounded linear maps from 38 into 38. For h\ and h 2 in 38 , d 2 F(x )h\h 2 , 
by which we mean [d 2 F(x )hi]h 2 , is an element of 0, and, therefore, 
d 2 F(x ) can be regarded as a bilinear map from 38 X 38 into 38, i.e., it 
can be identified in the obvious way with such a map. This bilinear 
map satisfies the symmetry condition that [d 2 F(x )hi]h 2 = [d 2 F(xo)h 2 ] 
hi. In general, 30 the mth order Frechet derivative d m F(x ) for m > 1 is 
a bounded linear map from 38 Q into a Banach space of bounded linear 
maps with || d m F(x ) || defined in the usual way in terms of induced 
norms, and d m F(x ) can be regarded alternatively as a symmetric m- 
linear map from 38™ into 38. Moreover, for 1 < / < m and h u h 2 , • • • , 
hi elements of 38 , d m F(xo)hih 2 • • • hi is a bounded linear map from 
38 into a Banach space of bounded linear operators. 

A result that we shall use is the following essentially standard 
inverse function proposition (Ref. 30, p. 273).* 

Lemma 1: Let F.X-* 38be continuously Frechet differentiable on X, 
and let x G X. IfdF(x ) is an invertible map of38 onto 38, there is an 
open neighborhood V C X of x such that F restricted to V is a 
homeomorphism of V onto an open neighborhood of F(x ) in 38. In 
addition, if F is r times continuously differentiable on V, the inverse 
mapping G of F(V) onto V is r times continuously differentiable on 
F(V). 

Also of importance in our work are derivatives of Banach-space- 
valued maps defined on an open subset S of the real or complex 
numbers. If F maps S into 38 and s G S, then F is said to have a 
derivative dF(s )/ds at s if dF(s )/ds is an element of 38 and we have 

lim||y- 1 [F(s + y) - F(s )] - dF(so)/ds\\ = 0. 

Again, higher order derivatives are defined in the usual inductive way. 
Here derivatives are elements of 38. 

2.1 f and g 

Throughout the paper, f:X -» 38 denotes a map with the property 
that there is a nonempty open convex subset U of 38 such that for each 
bG U, there is in X a unique x u such that f(x u ) = u. (Recall that X is 
a nonempty open subset of 38o). 



* With regard to a difference in a hypothesis of Lemma 1 and the cited proposition 
in Ref. 30, we note that if A is a bounded linear invertible map of 38* onto & with inverse 
A~\ then, by a result of Banach, this inverse is a bounded linear map of 96 onto 08 o . 
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We shall be concerned primarily with the map g:U-*X defined by 
f[g(u)] — u for every u e U. 

2.2 A representation theorem for g(>) 

We shall refer to the following two hypotheses: 
H.l: For some positive integer p, the mth order F- derivative 
(i.e., Frechet derivative) d m f exists and is continuous on X for m = 
1, 2, ... , (p + 1). 

H.2: [df(x)] l exists [i.e., df(x) is an invertible map of 08 o onto 38] for 
XE.X. 

Theorem 1: Suppose that H.l and H.2 are met, and let u and u 
be points in U. For m - 1, 2, •••,/> + 1 and each ft E [0, 1], let 

gm(uo, u — wo, /?) be defined as follows: 

Ma) gi(uo t u - uo, 0) = df{g[uo + 0(w - Oo)]} -1 (u - Uo) 

l.(b) £ m (Uo, U- Uo,P) = 

-df{g[uo + /?(*/ - uo)]}" 1 £ (J!)" 1 I 

A,>0 

• d l f{g[uo + p(u - Uo)]}g kl (uo, u-uo, P)gk 2 {uo, u-Uo,P) 

' * • gk,(Uo, U - Uo, P)* (1) 

for m = 2, • • • , p + 1. 

Then g p +i(uo, u — Uo, fi) depends continuously on ft for ft G [0, 1], 
and we have 

g(u) = g(Uo) + gi(Uo, u - Uo) + • • • + gp(Uo, u- Uo) 

+ (p + 1) (1 - P) p g p+1 (uo, u-uo, P)d/3, 



in which gmim, u - uo) = g m (uo, u-uo,0)form = l, ••«,/>. 

Moreover, 

2. (a) there are positive constants p and a, which do not depend on 
u, such that 



p 

g(u) - g(Uo) - £ gm(Uo, U- Uo) 



<p\\u-uoY for \\u- uo\\<a, 

2.(b) there are positive constants pi, p 2 , ••• , p p , which do not 
depend on u, such that \\g m (uo, u - uo)\\ < p m ||u - uo|| m for m = 
1, 2, • • • , p, and 



* In (!)- £*, + a 2+ ... +*,_„, denotes a sum over all positive k u ••• ,k, that add to m. 

*>o 
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2.(c) for m - 1, 2, • • • ,p we haveg m (uo, u a -uo) = r m g m (uo, u b - uo) 
for u a and u b in U such that (u a - uo) = r(u b - Uo) for some real 
number r. 

Proof: By H.l, H.2, and Lemma 1, the mth order F-derivative d m g(w) 
exists and is continuous for m = 1, 2, • • • , (p + 1) and w E. U. 

By a version of Taylor's theorem for Frechet differentiable maps 
(Ref. 30, pp. 190-1), 

g(u) = g(uo) + dg(uo)(u - mo) + 2j d 2 g(uo)(u - uo) 2 



I 



+ ... + - d p g(uo)(u - uo) p 



(1 fi) " d {p+l) g\u« + P(u - uo)](u - uo) p+1 d/3, (2) 



where (u - wo) m , for m = 1, 2, • • • , p + 1, denotes [(u - uo), (" - uo), 
• • • , (u — uo)] with m terms. 

Since d m g(w) exists for m = 1, 2, • • • , p + 1 for w belonging to 
the convex set U, d m g[uo + P(u - uo)]/dp m exists and is equal to 
d m g[uo + P(u - Uo)](u - uo) m for P E [0, 1] and m = 1, 2, • • ■ ,p+ 1 

[31, p. 198].* 

Let q(P) denote g[uo + P(u - Uo)] for all real P such that uo + 
p(u - uo) E U, and let ? (m) (jff) stand for the mth derivative of q(P) 
with respect to p at the arbitrary point P E [0, 1]. 

We have f[q(P)] = «o + /?(" - "o) when u + /?(" - uo) E £/. By a 
version of the chain rule (Ref. 31, p. 173) for the derivative of a 
composition function, 

df[q(P)]q ll) (P) = u-uo, P E [0, 1] (3) 

since df[q(P)] and q w (P) exist for E [0, 1]. Thus, 
dg[uo + P(u - Uo)](u -uo)= q a) (P) 

= df[g(uo + P(u - UoWHu -uo), P E [0, 1] (4) 

Now let 2 < m < (p + 1), and let f :@o -> @ and g : (-°°, °°) -» ^o be 
defined by 

m 

My) = I (l\r l d l f[q{p)][y - q(P)] 1 (5) 



• More specifically, since with h - (u - Uo), #[uo + (0 + o)A] = g(uo +fify + 
d^(uo + ,8Wa/i + o(|| <tA||) as o-» (for G [0, 1]), it is clear that dg(u<> + fih)/dp exists 
and is equal to dg(uo + Ph)h for fi E [0, 11. Similarly, using d m l g[uo + (P + a)h] = 
d m - l g(uo + ph) + d m g(uo + fih)ah + o(\ah\\) as a -> for 2 < m < (/> + 1), we see that 
d m £(uo + ph)/dfi m = d m g(uo + Ph)h m for 1 < m <= (p + 1). 
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<7o(r) - q(fi) + I (/!)-*(r - 0)^(0) (6) 



/=i 



fory E @o and r £ (-00, 00), where /? E [0, 1]. We will use the following 
generalization of the classical rule for differentiating a product of two 
differentiable functions. 

Proposition 1: With S a Banach space and A an open interval in 
(-00, 00) containing a point r , let L(r) denote a bounded linear map 
from @o into S for each r E A, and let <?(•) be a map from A to @ Q . If 
dL(r )/dr and de(r )/dr exist, then a\L(r)e(r)]/dr exists atr = r , and 
a\L(r)e(r)]/dr = L(r)de(r)/dr + [dL(r)/dr]e(r) at r = r . 

A proof of Proposition 1 is given in Appendix A. Using Proposition 
1 and the observation that d m f[q{p)]/dp n = for E [0, 1] when 2 < 
m<(p+ 1), we show in Appendix B that d m { fo[q (r)]} /dr m \ ^ fi = 6 
for fie [0,1]. 

Since we have 

fo[qo(r)] = i Wr l d'f[qW] (£ WHr - 0V*(fl) 

for every r, and each d'f[q(fi)] can be regarded as a /-linear operator 
on a' , it follows that for ft E [0, 1]: 

= d m fo[qo(r)]/dr m \ r - f3 

m 

= m\Z (11)-' 2 (MM • • • ktir 1 

/-l k i +k i +---+k l =m 

kj>0 

• d'f[q(fi)]q (k ^)q^(fi) . . . q M(fi) . (7) 

Referring now to the g m (uo, u - uo, 0) in the statement of the 
theorem, notice that gi(uo, u-Uo,P) = q {1) (fi) for p E [0, 1], and that, 
by (7), g m (uo, u - uo, P) = (m!)-y m) (jff) for 2 < m < (p + 1) and 
P E [0, 1]. Therefore, using (2) and q M (fi) = d m g[uo + (u - 14,)]. 
(m - Uo) m for /? E [0, 1] and each m, we obtain the formula for g(u) 
given in the theorem, in which g p+ i(uo, u - Uo, fi), which is equal to 

[(p + l)\T l d ip+li Auo + fi(u - Uo)](u - uo) {p+1) , 

depends continuously on fi for < fi < 1. 
Since 

g m (uo, u - Uo) = {mX)- l d m g{uo)(u - Uo) m 

for m = 1, 2, • • • , p in which d m g(uo) is an /nth order Frechet 
derivative,* it follows at once that properties 2.(b) and 2.(c) hold. 



* In particular, d m g(up) and d m g(uo)vi • • ■ v m -i for 1 < / < m - 1 and u, G A for 1 < 
j < m — I are bounded linear maps on #. 
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Finally, and referring to (2), since 

\\d {p+1) g(uo)(u - m) <p+1) \\ ^ \\d {p+1) g(uo)\\-\\u ~ "oll (P+1) . 

property 2.(a) is a consequence of the result (Ref. 30, pp. 190-1) that 
for every a > there is a a > such that 



g(u) - dg(uo)(u - Mo) - - y d 2 g(uo)(u - Mo) 2 



(p + 1)1 

for II m - Mo II < a. 



d ip+l) g(uo)(u - Uo) 



- M«\<P + » 



<=a ||K-i«o|| <p+1) 



32 



2.3 Corollary to Theorem 1 

Corollary 1: Suppose that H.l is met, and that Mo E U is such that 
df[g(uo)] is invertible (i.e., is an invertible map of @o onto @). 
Then there are positive constants p and a such that for u £ U with 

|| u- Uo||£a, 

\\g( U ) - g(Uo) - gi(Uo, U - Uo) g P (U0, M - Mo) || 

<p||M-Mo|| (P+1) , 

in which gi(u , u - uo), • • ■ , g P (u , u-uo) are defined in Theorem 1. 
In addition 2.(b) and 2.(c) of Theorem 1 hold. 
Proof: Since df( • ) is continuous on X, and, by a theorem of Banach, 
dfigiuo)]' 1 is bounded, by a standard type of argument (see, for 
example, Ref. 30, pp. 154-5) df(-)' 1 exists and is continuous* in some 
open neighborhood T of g(uo) in X. Also, since df[g(uo)T* exists, T 
contains an open neighborhood Ng iUo ) and U contains an open neigh- 
borhood Nuc of Mo such that /"restricted to N giUo ) is a homeomorphism 
of N g{Uo) onto Nuq (see Lemma 1). Let S be a nonempty open convex 
subset of N Uo . At this point the corollary follows from Theorem 1 with 
X=N g{UQ) tmdU=5. 

2.4 Comments 

For a fixed uo, the expansion given in Theorem 1 has the properties 
that the homogeneity condition 2.(c) is met and the remainder, the 
integral, is bounded above by p || m - Mo || <p+1) for || u - Mo || < a for some 
positive constants p and a. A proof given in Ref. 33, p. 174 can easily 
be modified to show that the expansion is unique in the sense that 
there is no other similar [i.e., #(mo) plus p terms plus remainder] 
expansion of #(m) valid for all u E U with these homogeneity and 



* The continuity is not used in the present proof. It is used in Section 2.7 and in 
Appendix C, where reference is made to this proof. 
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remainder properties. Of course, a corresponding uniqueness proposi- 
tion holds in the case of the truncated expansion in Corollary 1. 

In some cases, d l f[g(uo)] of Theorem 1 is the zero map whenever / 
is even and 2 < I < p. Then g m (uo, u - uq) = for m even with 2 < 
m<p. This follows from a simple inductive argument using l.(b) and 
the observation that k\ + k?. + • • • + ki is an odd number if / is odd and 
each kj is positive and odd. 

Referring to Corollary 1, we can establish the existence of an 
expansion in a more general setting. Specifically, let &\ be a third 
Banach space and let /*(-, •) be a (p + 1) -times Frechet continuously 
differentiable map of S X S into 38\ , where S and S are nonempty 
open subsets of @ and 36, respectively. Let x and «o be elements of So 
and S, respectively, such that h(xo, uo) = 0, in which here is used to 
denote the zero element of 8 X . Finally, assume that D\h(xo, Uq) the 
Frechet partial derivative of h(x, u) with respect to x, at the point 
(xo, Uo), is an invertible map of H8o onto 8&\ . 

By the implicit function theorem in Ref. 30, p. 270 and a related 
proposition in Ref. 30, Result (10.2.3), it follows that there is an open 
convex neighborhood N of uq in S, and a (p + 1) -times Frechet 
continuously differentiable map w of N into So such that w(uo) = xq 
and h[w(u), u] = 6 for u e N.* Therefore (2), with g replaced with w, 
is a representation about Uo of w valid for u £ N (Ref. 30, pp. 190-1). 
It can be shown that the terms in the representation can be determined 
by successively differentiating h{w[uo + P(u — Uo)], wo + P(u — uq)} 
with respect to /? and setting the result equal to 6. [Recall that 
D\h(x , Mo) is assumed to be invertible, and see the proof of Theorem 

i.r 

The proof of Theorem 1 shows that the recursive relation (1) arises 
in a natural way. Such formulas concerning the inversion of ordinary 
power series and/or the derivatives of composite ordinary functions 
are probably well known in some circles. In Ref. 29, similar relations 
are given in an abstract setting for the different problem of constructing 
a local inverse of a mapping that has a power series expansion. 

The expansion of g(u) in Theorem 1, and its associated trunca- 
tion in Corollary 1, each contains a constant term g(iio), a term 
gi(uo, u — uo) that can be written as L Uo (m - Uq) in which L^ is a 
bounded linear map, and a sum R^u — uq) of higher order terms such 



* Also, N can be chosen so that w is the only continuous map of N into So such that 
w(uo) = xo and h[w(u), u] = 6 for u £ N. 

+ Similar remarks apply also in the case of Theorem 4, below. By applying either 
Theorem 2 or Theorem 5, below, to the map H:S x S — » fii x B denned by H(x, v) = 
[h(x, v), v] for (x, u) E So x S, the writer has obtained an explicit expansion, involving 
partial derivatives of h( ■ , • ), for the solution x of h(x, u) = w in terms of u and w, under 
certain reasonable assumptions concerning h(-, •) and the sets from which u and w are 
drawn. The details will be given in another paper. 
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that Rujih) = o (|| h ||) as || h\\ -> 0. The following result shows that the 
hypothesis of Theorem 1 that H.2 is met, and of Corollary 1 that 
df[g(uo)] is invertible, are not merely ones of convenience which allow 
an explicit expression to be given for the terms. 
Proposition 2: Let uo be an element of U such that df[g(uo)] exists 
[respectively, such that f is continuously F-differentiable on a neigh- 
borhood ofg(uo)]. Suppose that there is a constant a > such that 

g(u) = g(uo) + L(u - uo) + R{u - uo) (8) 

foruGU with || u - Uo \\ < a, in which Lisa bounded linear map from 
36 into 36 , and R(-) is a map of 36 into 36o with the property that 
R(h) = o(\\h\\) as \\h\\ -> 0. Then dftgiuo)]' 1 exists [respectively, 
df(x)~ x exists and is continuous in x for x in some neighborhood of 

g(uo)]. 

The proposition is proved in Appendix C. It shows, for example, that 
H.2 is a consequence of the hypotheses that g{U) is an open set, X = 
g(U), fis differentiable on X, and (8) holds for each oo G U. In this 
connection, notice that because U is open, g(U) is open under merely 
the condition that / is continuous on X. 

2.5 Results for complex Banach spaces 

Theorem 2: Suppose that 36 and 36 Q are over the complex field, that 
the F-derivative d m f(x) exists at each xGXfor all m, and that H.2 is 
met. Let uo E. U, and let p be a positive constant with the property 
that Uo + V G U for || v \\ < p. Then for uE: U such that \\u- uo\\<p, 
we have 



in which 



and 



g(u) = g(uo) + £ gm(uo, u - uo), (9) 

gi(uo, u - Uo) = df[g(uo)Y l iu - wo). (10) 



lit 

g m (uo, u-uo) = -df[g(uo)V 1 CO -1 I d'f[g(uo)]g kl 

kj>0 

• (uo, u - uo)gk 2 (uo, u - uo) "• gk,(uo, u - uo), m>2. (11) 

Proof: Here d m g exists on U for each m (see the proof of Theorem 1). 
In particular, dg exists throughout U, and therefore we see that 

lim z~\g(x + zh) - g(x)] 

2—0 

exists in S6o (and equals dg(x)h) for each x G U and h E 36, where z is 
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a complex scalar variable. Thus, by Theorem 3.16.2 of Ref. 34, p. Ill 
and the development preceding it, 

d m g[uo + z(u-u )]/dz m \ z -o 
exists for each m > 1, and we have 

g(u) = g(ua) + 2 Wr l d m g[u + z(u - u )]/dz m \ i . 

for || u — Uq II < p. 
Notice that 

d m g[u<> + z(u - uo)]/dz m \ z= o = d m g[u + r(u - u )]/dr m \r-o 
in which r is a real variable. Since (see the proof of Theorem 1) 

d m g[uo + r(u - uo)]/dr m \ r =o = mlg m (uo, u - Uo), 
the proof is complete. 

Theorem 3: Let the hypotheses of Theorem 2 hold. Then for each u 
there is aa>0 such that the series on the right side of (9) converges 
uniformly for \\u — Uo\\< a. 

Proof: The proof of Theorem 2 shows, using the openness of U, 
that for each Mo there is a p > such that the series converges for 
|| u - «o|| < p. Since dg exists on U, g is continuous on U. The map g 
is, therefore, locally bounded on U in the sense of Ref. 34, Definition 
3.17.1, and thus the proof of Theorem 3.17.1 of Ref. 34, p. 112, shows 
that, given wo, there is a a > such that the convergence is uniform for 
|| u — Uo || < a. 

The following result is obtained from Theorems 2 and 3 in the same 
way that Corollary 1 is proved. 

Theorem 4: Assume that 38 and @ are over the complex field, and 
that d m f exists on X for each m. Let u G U, and suppose that 
df[g(uo)] is an invertible map of 3S onto 38. Then there is a a > 
such that the expansion 

g(u) = g(uo) + X gm(uo, u- Uo) 

is valid and uniformly convergent for u e U with \\u- uo\\<a, where 
gi(uo, u - uo), g2(uo, u - uo), ■•• are defined by (10) and (11). 

2.6 Comments 

Under the conditions of Theorem 2 (respectively, Theorem 4) the 
infinite sum R(u — uo)of the terms giiuo, u - u ), gs{uo, u - u ), • • • 
has the property that R(h) = o(\\h\\) as \\h\\ -* 0. (This follows from 
the fact that dg(uo) = df[g(u )]~ l .) Therefore, Proposition 2, as well 
as remarks similar to those of Section 2.4, apply here too with regard 
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to the necessity of the hypothesis that H.2 is met (respectively, 
df[g(uo)] is invertible). 

Following is an interesting corollary of Theorems 2 and 3. 
Corollary 2: Suppose that & and @ are complex Banach spaces, and 
that f is a C x -diffeomorphism of X onto U (i.e., that f is a homeo- 
morphism ofX onto U such that f and its inverse g have F-derivatives 
of all orders on X and U, respectively). Let m e U, and let p be 
a positive constant with the property that m + v E U for \\v\\ < p. 
Then the series representation (9), in which the g m (uo, u - Uo) are 
given by (10) and (11), is valid for \\u- Uo\\< p, and there isaa>0 
such that the series on the right side of (9) converges uniformly for 

\\U — Mo|| < O. 

Proof: Since {df)' 1 exists on X under the conditions of Corollary 2*, 
Corollary 2 follows from Theorems 2 and 3. 

2.7 Discussion 

Uniqueness propositions similar to the one described in Section 2.4 
apply in the cases of Theorems 2 and 4, as well as Corollary 2. Consider, 
for example, Theorem 2 and assume that its hypotheses are met. From 
(10) and (11) (or from the proofs of Theorems 1 and 2), we see that the 
expansion on the right side of (9) has the homogeneity property that 
for each m, g m (uo, u a -uo) = r m g m (u<>, u b - Uq) for u a ,u b EU such that 
|| u a - Mo|| < P, || m 6 - Mo || < p, and (M a - Mo) = r(u b - Mo) for some real 
r. Suppose that g(u*) + £m=i h m (uo, u - Mo) is also an expansion of 
g{u) about mo valid for ||m - Mo|| < p, and that it has the corresponding 
homeogeneity property. Assuming, for the purpose of induction that 
h m (uo, m - Mo) = #n(Mo, m - mo) for ||m - Mo|| < p and 1 < m < n for 
some nonnegative integer n, we see + that for any fixed u such that 

|| M — Mo || < P, 

h n +l(Uo, U~ Mo) - gn+l(Uo, U - Mo) 

= 2 [^ m (Mo, M " Mo) " MMO, M - Mo)]^-"-" (12) 
m—n+2 

for0< |r| < 1. Since 

SUp||^m(Mo, M - Mo) - h m (Uo, M - Mo) || 



• We have f[g(u)] = u and g[f(x)] = x for each u E U and each x E X. Thus, by a 
version of the chain rule for differentiating a composite function (Ref. 31, pp. 171-2), 
df[g(u)]dg(u) = I and dg[f(x)]df(x) = h for each u and x, where / and h are the 
identity maps on 98 and 9S , respectively. This shows that dfix) has both a right inverse 
and a left inverse for each x E X, and, therefore, that (df) exists on X. 

+ This type of observation is used in Ref. 33, p. 174, to prove the uniqueness result 
given there. 

1 70 THE BELL SYSTEM TECHNICAL JOURNAL, FEBRUARY 1 982 



is finite, the right side of (12) approaches zero as r — > 0. Thus h n+l - 
(uo, u — uo) = gn+i(uo, u — wo), and, therefore, h m (uo, u — uq) = g m (uo, 
u — uq) for all m and all u such that \\u — iio\\< p. 

The proof of Theorem 2 is based in part on basically well-known 
results concerning Banach space valued functions of a complex vari- 
able. Such results are used also in, for example, Refs. 20 and 24 for 
related but different purposes. 

A comparison of Theorems 1 and 4 leads us to ask whether Theorem 

I can be used to prove a result along the lines of Theorem 4 for cases 
in which 08 and S6o are not necessarily over the complex field, but the 

II d m f(x) || are sufficiently small in some not too restrictive sense for x 
near^r(uo). In this connection, we have the following. 

Theorem 5: Let d m f exist on X for each m, and let uq be a point in U. 
Suppose that there are positive constants 8 and y, and a neighborhood 
No ofg(uo) in X, such that \\d m f(x)\\ < m!Sy m for x E No and every 
m > 2. Assume that df[g(uo)] is an invertible map from 3&o onto 36. 
Then the conclusion of Theorem 4 holds. 

Proof: By the proof of Corollary 1, it suffices to show that there is a 
a > such that 



(p + 1) (1 - /3) p g P+ i(uo, u-uo, P)dP, 
Jo 

the remainder in the expansion for £(iz) of Theorem 1, approaches 6 as 
p -> oo uniformly for \u - Uo|| < a. Since Jo (1 - P) p df5 = (p + 1)~\ it 
is enough to prove that there are constants a > 0, d > 0, and c> such 
that for all p, all fi G [0, 1], and all u e f/with \\u - uo\\ < a, we have 
||£ p (wo, U — Uo, ft) || £ ce~ dp . That we do as follows. 

By the continuity of g at Uo, and the continuity of (df)' 1 at g(uo) 
(see the first part of the proof of Corollary 1), choose a > so that 
U contains the open ball of radius a centered at uo, and \\df{g[uo + 
/3(u - a)]}- 1 )! < c, and \\d l f{g[uo + 0(u - Uo)]}\\ < l\8y l for some 
constant Ci whenever (3 E [0, 1] and \\u - Uo\\ < a. 

Choose any positive number d. For each m, let h m denote 
sup{|| e dm g m (uo, u-uo,P) ||:/3 E [0, 1], || u - uo\\ < a). From Parts l.(a) 
and l.(b) of Theorem 1, and our hypotheses, the h m are finite, and we 
have 

P p m 

2 h m < e d Cl a + Cl 8 £ £ £ y l h ks hk 2 • ' • A* 

m—l m-2 /-2 j^+AjH yk t —m 

A, >0 



for each p > 1. Since 



p-i 

S h m I = X /*A,/*A 2 • •• hk, 
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over (ki, k 2 , • • • , ki) E {1, 2, .... (p - 1)}', it easily follows that 

p m P /P-i 

n 2 y l h kx h k2 ---K^ ZyI X A- 

m-2 /-2 A,+A 2 +- ••+*/-"« '" 2 X 7 "" 1 

A,>0 



Thus, with 



we have 



p 
&p = 2j ""mi 

m-l 



s p < e d cio + ciS j (ysp-i)' 



p 

Z 

f-2 



forp> 1. 

Now let c> be chosen such that 

Cifi 2 (yc)' < 5 c, 

1-2 £ 

and, if necessary, reduce a so that e d Ci<r < %c. Since Si < %c, and 
S(p-D < c implies that s p < c forp > 1, it is clear that s p <c (and hence 
A p < c) for all p, which completes the proof. 

2.8 Comments 

Since the hypotheses of Theorem 5 can be shown to ensure the local 
existence of a Frechet "power series" expansion (see Ref. 30, p. 190) of 
f about g(uo), another way to prove Theorem 5 is to use the result 
stated in Ref. 29. The observation concerning the representation of 
(Sp-i) 1 as a sum of products used in our proof to obtain the inequality 
involving s p and s p -i (but not the exponential weighting approach) is 
used also in Ref. 27 for a case that corresponds here to the one in 
which only a finite number of the || d l f\\ do not vanish. 

Theorem 1 can also be used to prove nonlocal convergence results 
when & and ^ are not necessarily complex spaces. For example, let 
p be the radius of any finite open ball contained in U and centered at 
Uq. Suppose that for every x £ X the following is true: d m f(x) exists for 
each m, df(x)' 1 exists, and || df(x)~ l || < pa for some constant p . Then, 
using Theorem 1, it can be shown that if the || d m f( • ) || satisfy certain 
smallness conditions on X for m > 2, the expansion described in the 
conclusion of Theorem 2 converges uniformly to g{u) for \\u - Uo\\ < p. 
The "smallness conditions" are met if, for example, 

sup || d m f{x) || = for m>M for some M > 2, 

and each nonzero 
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8lip\\d m f(x)\\ 
xeX 

with m > 1 is sufficiently small. The details and a proof will be given 
in a later paper. 

2.9 Properties 1 and 2 

We conclude this section with a proof of a proposition used in 
Section III, where attention is directed to cases in which the elements 
of 81 and @ are functions of a time variable t. The proposition is used 
to show that under certain very reasonable conditions, causality and 
time invariance (or periodicity of variation)* are properties which, 
when possessed by g, are inherited by the terms gi(uo, u - ito), • • • , 
g p (uo, u — ito) in Theorem 1, and by the terms gi(iio, u — Mo), 
g-Auo, u — Mo), • • • in Theorem 2. We first introduce some preliminaries. 

Let ft denote a nonempty set of real numbers. For each w G ft, let 
T u and T 0u denote linear transformations of 06 and # , respectively, 
such that || 7ou.m;|| < || w\ for w G ft and w G 3 Q . Let S be a subset of 
81 such that T U S C S for w G ft. Let J denote an open interval in the 
set R 1 of real numbers. 

We say that a map F:J X S -* @ has Property 1 on S at a point 
rGJif 

T 0u F(r, v) = T 0u F(r, T u v) 

for all v G S and w G fi. Finally, we say that F:J X S — > & has 
Property 2 on S at a point r in J if 

T 0u F(r, v) = F(r, T u v) 

for v G S and w G ft. 

Proposition 3: Suppose that F:J X S -* ^ Aas Property 1 (respec- 
tively, Property 2) on S for each r G J, and that for an arbitrary v G 
S the derivative dF(r, v)/dr exists at each r£j. Then the map H:J 
xS-»4 defined by H(r, v) = dF(r, v)/drfor each r and each v, has 
Property 1 (respectively, Property 2) on S for each r G J. 
Proof: Assume initially that F has Property 1. Let arbitrary rE.J and 
v E. She given and let /? be a real variable. Using 

]im\\p-\F(r + 0, v) - F(r, v)] - H(r, v)\\ = 0, 

/9-.0 



we have 



lim||^- 1 [T 0u F(r + 0, v) - T 0w F(r, v)] - T 0u H(r, v)\\ = (13) 

0-.O 



* See Section 3.1 for the pertinent definitions. 
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for any w £ ft. Since (13) holds also with v replaced with T a v, and 
using the hypotheses that F has Property 1 on S at r and at (r + 0) for 
sufficiently small /?, we find that 

lim||A(/?) + T 0u H(r, v) - T 0u H(r, 7»|| = 0, 



/?^o 



in which A(0) = /T^Ffr + ft tf) - To tt F(r, »)] - T 0u H(r, v). By 
(13), ||A(y8)|| -»• as /? -► 0. Therefore, we have T 0u H(r, v) = 
To u H(r, T„v) for arbitrary w e ft, as claimed. The Property 2 part of 
the proposition can be proved in essentially the same way. 

III. APPLICATIONS AND EXAMPLES 

Throughout this section, we consider cases where each element of 
38, and also of 38 , is a function of a time variable t. Specifically, we 
now assume that each element of 38 is a map from a set T of real 
numbers into a linear space V with zero element V , and, similarly, 
that the elements of 38 are maps from T into a linear space V with 
zero element By. 

We shall be concerned mainly with the cases where either S8 = 
® Q = Loc(R) or 36 = ® Q = L„(C), in which by L„(R) [respectively, 
L„(C)] we mean the real (respectively, complex) Banach space of 
(Lebesgue) measurable* real (respectively complex) column n-vector 
valued functions v defined on the interval [0, oo) such that the jth 
component Vj of v satisfies 

sup|l>y(£) | < °° for j = 1, 2, • • • , n, 

and where the norm || ■ || on Lco(R) or L„(C) is given by 

\\v\\ = max sup| vj(t) |. 
/ t 

(As usual, n denotes an arbitrary positive integer.) If, for example, 
^ = gg Q = Loo(R), then T = [0, oo) and we can take V and Vo to be R n . 

3. 1 Causality and tlme-invariance 

Referring to Proposition 3 and the associated definitions, let ft = T, 
and initially let T u (respectively, To J be the "time-truncation" oper- 
ator defined on 38 (respectively, 38 ) by (T u v)(t) = v(t) for t < w, and 
(T u v)(t) = O v fort>u (respectively, by (T „v)(t) = v(t) for t < co, and 
(T 0u v)(t) = 8v for t > w) for each v and each <o. Assume that for w E 
T, T u and T 0u map ^ and 38 into themselves, and that || T 0u v\\ <\\v\\ 



* See, for example, Ref. 35. 
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for to G T and all v. [Notice that these assumptions are satisfied if, for 
example, ® = @ = L X (R) or @ - 3S Q = L„(C).]* 

Suppose that the hypotheses of Theorem 1 are met, that U is an 
open ball centered at wo = 0, that T u U C U for w e T [which is clearly 
satisfied if 38 = Lco(R) or Loo(C)] and initially assume that g is causal 
on U in the sense that T 0u g(v) = T 0u g(T m v) for any v G f/and uGT. 

Let G m (w) denote g m (0, u) of Theorem 1 for m = 1, 2, • • • , p and 
m G [/. We observe that #(/?«) is an element of S6 Q for each /? G (-1, 1) 
and each u G U. By the proof of Theorem 1, d m g(>) exists on [7 for 
m = 1, 2, • • • , p, from which it follows that d m g(fiu)/dft m exists for 
/8 G (-1, 1), w G U, and m = 1, 2, • • • , p [31, p. 198]. By the proof of 
Theorem 1, m\G m (u) = d m g(fiu)/dfi m at = for each m and m. 
Therefore, by the Property 1 part of Proposition 3 [with S = U and 
J- (-1, 1)] and an obvious inductive argument, it follows that each 
G m : U — > ^o is causal in the same sense that g is causal. 1 ^ 

Now suppose that T is one of the four sets [0, oo), (-<», oo), 
{0, 1, 2, • • .}, or {0, ±1, ±2, • • •}. Again take S2 = T. Let T„ (respectively, 
To J denote the "time delay operator" defined by (T u v)(t) = dv for 
t < oi and (T u v)(t) = v(t - w) for t > u when either T = [0, oo) or T = 
{0, 1, 2, • • •}, and by (T u v)(t) = v(t - to) when T = (-oo, oo) or T = 
{0, ±1, ±2, • • •} (respectively, (To-dM*) = 0v for * < to and (To«i>)(*) = 
u(* - u) for * > to if T is either [0, oo) or {0, 1, 2, ... }, and (T 0u v)(t) = 
v(t - a) when T is either (-co, oo) or {0, ±1, ±2, •••}). Assume here, 
as above, that T„ and T 0u map !% and 3S , respectively, into themselves, 
that || 7o u i>|| ^ || tf || for each l» and u, that the hypotheses of Theorem 
1 are met, that U is an open ball centered at 6, and that uq = 0. 
Consider the case in which g is causal on U, and g maps the zero 
element of 3& into the zero element of SS . Assume that g is time 
invariant on U in the sense that T 0u g(u) = g(T u u) for u G U and 
to G T. Let G m be as defined in the preceding paragraph. By the 
Property 2 part of Proposition 3, and the observations concerning 
d m g{fiu)/d(S m in the preceding paragraph, we see that each G m (m = 
1, 2, • ■ • ,p) is time invariant on U. 

The material just described can be modified to address the case in 
which g is periodically varying with a given period t. Specifically, 
suppose that T is [0, oo), (-co, oo), {0, 1, 2, ■ • .), or {0, ±1, ±2, • • •}, and 
that t is a positive element of T. Let T u and To u be as defined in the 
preceding paragraph, but with S2 taken to be the single-element set 
(t) rather than T. Then, in the setting described in the preceding 



* The assumptions are not met for ® the set of bounded continuous functions from 
[0, oo) to J? . 

f Our definition is consistent with the one introduced in Ref. 36, p. 888, concerning 
causality for operators between abstract spaces. Also, a related result is given in Ref. 37, 
p. 40, for polynomial operators. 
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paragraph, T Qu g{u) = g{T u u) for u G U and a G fl means that g is 
periodically varying with period t on £7, and we see that if £ has this 
property, it is inherited by the G m . 

In the case of Theorem 2, each d m g(-) exists on U (because H.2 
holds), and g m {B, u) = (m\r 1 d m g{fiu)/dfi m at /? = for each m = 
1, 2, • • • and || u || < p. Therefore, results essentially the same as those 
developed in the preceding four paragraphs hold also with regard to 
the terms in (9).* 

3.2 An application of theorem 1 

Our first example, as well as the example in Section 3.3, concerns a 
nonlinear integral equation that plays an important role in the theory 
of feedback systems. To introduce the equation, we need the following 
definitions. 

Let «o and ai be positive numbers with a ^ «i, and let ^i, \p2, • • • , 
\p n be a collection of (p + 1) -times continuously differentiable functions 
from R 1 onto R 1 such that ifc(O) = and oo < d\pi(\)/d\ < a x for all i 
and all X. Below, for convenience, we shall use $ m) to denote the mth 
derivative of >//,. Let \p denote the map from R n into R n defined by 
[\p(s)]i = +i(8i) fori = 1,2, • • • , n and all s G R n , in which ty(«)]j and 
Si are the ith components of yp(s) and s, respectively. 

Let k denote annXn matrix-valued function defined on [0, oo) such 
that each ktj is measurable, bounded, and satisfies 



f 



\kij(T)\dT<0O. 



In this and the following section, each kij is assumed to be real 
valued. 
Consider the equation 

x(t) + I k(t - T)xftx(T)]dT = u(t), t > 0, (14) 

Jo 

as well as the related equation 

y(t) + ( k(t - T)D(r)y{r)dr = v(t), t > 0, (15) 

Jo 

in which u and v are elements of Lco(R), and D is a real n X n diagonal- 
matrix-valued function defined on [0, oo) such that each Du is measur- 
able on [0, oo) and satisfies oo < Du(r) < ai for each t. Since ^ satisfies 



* Specifically, the development remains valid if U is taken to be {« G #:||u|| < p), 
and if "Theorem 1" and "m - 1, 2, • • • , p", respectively, are replaced with "Theorem 2" 
and "1, 2, • • • ." 
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a global Lipschitz condition on R", and k is as indicated, a standard 
successive-approximations approach (see, in particular, Ref. 38, Sec- 
tion 1.13) can be used to show that for each u and v in Z/„(R), (14) and 
(15) have solutions x and y, respectively, in the space E of functions w 
from [0, oo) into R" such that 



r 

Jo 



I Wi(r) \ 2 dr < oo 



for each A G (0, oo) and each i, and that x and v are unique in E* To 
fix ideas, assume (this is often very easy to justify) that the only 
solutions of (14) of interest to us are those that are contained in E. 

Let A.l denote the hypothesis that for each u and v in L m (R), L„(R) 
contains any solution x of (14) in E, as well as any solution y of (15) in 
E. For explicit conditions on k, ao, and a x under which A.l holds, see 
Ref. 36, Theorem 3. 

Assume initially that A.l is met, and notice that then for each pair 
of elements u,vG L 00 (R), the space Loo(R) contains exactly one element 
x such that (14) is satisfied and exactly one element v such that (15) is 
met. In particular, we see that we can take fin Section 2.1 to be the 
map of Loo(R) into itself defined by 



J k(t- 

Jo 



f(w)(t) = W{t) + kit- T)l//[H>(T)]dT, t > 

Jo 

for each w G L 00 (R), and can take 36, 3S , X, and U to be L^iR). In this 
example, g is defined on all of 38. 

To discuss the example in more detail, it is convenient to let K and 
¥ denote the maps of LadR) into L„(R) defined by 



Jo 



iKw)it) = kit - T)wir)dr, t > 

Jo 

i*w)it) = t[wit)l *>0 

for each w G L„(R). Thus, here f= I + K^fr in which J is the identity 
map on Loo(R). Consider ^. 

Proposition 4: cW exists on L X (R), and for w and h in Loo(R), we have 
[d*iw)h]it) = Do(t)hit) for t > in which Doit) is the diagonal 
matrix diag^Vitt)], tf t«*<*)l •• • . ^W)]}. 



* The integral on the left side of (14) can easily be shown to be an element of R" for 
each t whenever iGE. Since the value of the integral is unchanged if x is replaced by 
any element of E that agrees with x almost everywhere, (14) has a solution if there is an 
element of E that satisfies the equation almost everywhere, and, moreover, any solution 
x G E is unique and not merely essentially unique. Similar remarks apply in the case of 
(15). 
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Proof: For w and h in Lco(R), 
¥(ur + A)(f) -^{w)(t) 

= D (t)h(t)+ J [Do (t)-Do(t)]dp.h(t), *>0, (16) 
Jo 

in which D op (t) is the diagonal matrix of order n whose ith diagonal 
element is tftyfrprfi) + fe(*)] + d - 0)u/,-(*)]. Since each $° is uni- 
formly continuous on compact subsets of R\ we see that for any fixed 
w, the difference (Ay?, - Dot) of ith diagonal elements satisfies 

sap\Dofii(t)-Doi(t)\-+0 as ||A||-»0. 

Thus, with 8 G L„(R) denned by 8(t) = ft[Dop(t) - D (t)]d/3.h{t) for 
t > 0, we see that || 5|| = o(|| A||), which proves the proposition. 

Proposition 4, together with the discussion above concerning (14) 
and (15), show that df exists, that (using the linearity of K) df = 
I + Kd&{w) for each w, and that for any w the map df(w) is an 
invertible map of L 00 (R) onto itself. 

To make further progress, we need the following result which is 
more general than Proposition 4. 

Proposition 5: For each m = 1, 2, • • • , (p + 1), d m V exists and is 
continuous on Loo(R), and, with h h h 2 , • • • , h m any m elements of 
Loo(R), we have 

m 

[d"*(iD)Ai • • • h m (t)l = ti m) [wi(t)] n hji(t), t > 

for each i = 1, 2, • • • , n and any w G L„(R). 

Proof: Let w be given. By Proposition 4 and, (with regard to 
continuity) the observation that \\d<ir(w + v)h - d¥(w)h\\ < 
max, supfeol^W) + »<*>] ~ ^"W)]l for ll^ll = *» the assertion 
for m = 1 is true. Suppose that the assertion is true for m such that 
1 < m < / with / < (p + 1). 

Let Qi{w) denote the continuous multilinear mapping of L 00 (R) (/+1) 
into L„(R) defined by 



[Qi(w)(pi, P2, . • - , pw)W1- = $ Z+1) M')] n ftK*). * 35 o 



/+1 

n 



for each i and forp, G L„(R) for ally. We shall use Qi(w) to denote the 
usual associate (Ref. 31, p. 318) of Qi that belongs to L(Loo(R), L(L.(R), 
• • • , L(Loc(R), L.(R)) • • •)) with (/ + 1) L's, in which L(A U A 2 ) stands 
for the set of continuous linear operators from the Banach space A\ 
into the Banach space A 2 * 

♦ For example, if I « 2, L(L„(R), L(L.(R), • • • , L(I*(R), L.(R)) •••))= L(I«(R), 
L(L-(R), L(L-(R), L-(R)))). 
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By our induction hypothesis, and with h, as well as hj for j 
1, 2, • • . , /, elements of L.(R), 

||<f*(w + h)h x ■■• hi- d'*(w)hi ■ • • hi - Qt(w)hhi • . . fall 



= max sup 

I feO 



#[wK*) + hi(t)1 n MO - tffflwrW] II had) 

y-i >-i 

- M i+i) [wi(t)]hi(t) n mo 

y-i 



«c(*)iiim. 

y-i 
where 

c(/i) = max sup | #[«;*(*) + M*)] " 4*[utt(t)] - $ ,+1) [M*(*)]fc(*) I- 

Thus, | iff (10 + A) - (ff(i0) - Qi(w)h\\ < c(A). By the uniform 
continuity on compact sets of the $ l+1) (see the proof of Proposition 
4), we have c(h) = o(\\h\\) as \\h\\ -» 0, which shows that d {l+l) ty(w) 
exists and that d il+l) <ir(w) = Qi(w). Since \\Qi(w + h)pi ••• /> /+ i - 
Qi(w)pi • • • pi+ifl < 

/+i 
max sup |^ /+1 V«(0 + WO] " ^ l+ Vi«)]|- II 



f^-0 
!,('+» 



y-i 



and the \py +l) are continuous, we see that 

\\Qi(w + h)-Qi(w)\\-+0 as ||A||-»0, 

showing that rf (/+1) ^(i/;) depends continuously on w. This completes 
the proof. 

Returning now to our example, by Proposition 5 and the linearity 
and boundedness of K, we see that d m f(w) exists and is continuous for 
w e Loc(R) and m = 1, 2, • • • , (p + 1). (Of course, d m f = Kd m ^ for 
1< m < (p + 1).) Therefore, the hypotheses of Theorem 1 are satisfied. 
Now choose uq = in Theorem 1 and notice that g(9) = 6. 

Referring to the standard successive approximations technique (Ref. 
38, Section 1.13) that can be used to construct a unique solution x in 
E of (14) for each u G Loo(R), by the rule by which the iterates are 
generated it follows that g is causal and time invariant on Loo(R) in the 
sense of Section 3.1. Therefore, the material in Section 3.1 shows that 
gm(9, •) of Theorem 1 is both causal and time invariant on Loo(R) for 
each m = 1, 2, • • • ,/>.* 

The terms gi(6, u),g 2 (0, u), • • • , g p {6, u) in the expansion in Theorem 
1 can be determined using l.(a) and l.(b). + For example, with H 



* The same conclusion can be reached by considering the specific form of the 
g m (0, u), and using the fact that the operator H introduced below can be shown to be 
causal and time invariant. (In this connection, see Lemma 2.) 

f The recursive process is straightforward in principle, but the complexity mounts 
rapidly with increasing order. 
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denoting [7 + Kd9(6)T l > we have gi(d, u) = Hu, and, using gx(6, u) = 
Hu, we find that whenp > 2, 

g*(0, u) = -VrfUCd^dHHu) 2 (17) 

since k x + k 2 = 2 with Ai and k 2 positive integers requires that ki = 

k 2 = 1, and 

£ 3 (0, M ) = -V6HKd 3 *(e)(Hu) 3 

+ KHKd^mHuftHKd^mHu)*]. (18) 

[The derivation of (18) uses gi(0, u) = Hu, (17), and the observation 
that ki + k 2 = 3 is met if either ki = 1 and k 2 = 2 or ki = 2 and 

*2 = L] 
Proposition 5 provides an important interpretation of the terms in 

the expressions for the g m (0, u). For example, by Proposition 5, we see 

that d^(e)(Hu) 3 , which appears in the first term on the right side 

of (18), is the element s of L„(R) given by aft) - $*(0)[(Hu)(t)if 

for t > and each i. Similarly, the ith component of d 2< &(0){Hu)- 

[HKd 2 4>(6)(Hu) 2 ] in (18) has values +\ 2) (0)[(Hu)(t)i]qi(t), where q = 

HKd 2< lr(8)(Hu) 2 . Of course, q also has an immediate interpretation. 

3.3 An application of corollary 1 

Corollary 1 is in many respects a local version of Theorem 1. Here 
we give an example of an application of the corollary. As in Section 
3.2, let 09 = 3S Q = L 0D (R), and let K, ¥, I, and uo be as defined there, but 
here it is not required that A.l be met. 

Let F:Lco(R) -» -MR) be given by F = I + K9. As in Section 3.2, 
d m F exists and is continuous on L M (R) for m = 1, 2, -• , (P + !)• Of 
course, dF(d) = 1 + Kd9(0). 

Let z be a complex scalar variable, and let K, the Laplace transform 

of k, be given by 

K(z) = k(t)e- zt dt, Re(z) > 0. 

Jo 

Assume that 

det[l B + ^(2)diag{^ a) (0), • • • , ^'(O)}] * 

for Re(z) > 0, in which 1„ is the identity matrix of order n. As a 
consequence, it can be shown (see Lemma 2 in Section 3.5) that 
dF($):L„(R) -* L„o(R) is invertible. Thus, by Lemma 1, there are open 
subsets Si and S 2 of L.(R), each containing 0, such that F restricted to 
Si is a homeomorphism of Si onto S 2 . 

Therefore, the hypotheses of Corollary 1 are met if X is chosen to be 
Si, /"is taken to be the restriction of F to X, and U is any open convex 
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set contained in S 2 and containing 0. This establishes the existence of, 
and shows how to obtain, a series approximation with error o(|| u\f) as 
|| u || -> of the locally unique solution x of Fx = u, for u of sufficiently 
small norm. 

3.4 Physical systems, and an application of theorem 4 

In the following, H(C) denotes the linear space of complex column 
n- vector- valued functions h defined on [0, oo) such that, with T u the 
"time truncation" operator of Section 3.1, we have TJi G Loo(C) for 
w E [0, oo) (i.e., such that any truncation of h is bounded and measur- 
able). Clearly, unlike L„(C), H(C) can contain unbounded functions. 

Consider a physical system with an input v drawn from Loo(C) and 
an output w contained in H(C). Let the system be composed of linear 
elements, as well as nonlinear elements. Suppose that the nonlinear 
elements can be viewed as collectively introducing a constraint that 
can be written as y = Nx, in which N is a map from one subset of H (C) 
into another, and where x and y, respectively, are the H(C) input and 
output of the nonlinear part of the system. 

With regard to the remainder of the system, which is linear, assume 
that there are linear maps A, B, C, and D of if(C) into itself such that 

x = Av + Cy (19) 

w = Dv + By. (20) 

Concerning the degree of generality of the model, and the assumption 
that the values of v, w, x, and y have the same dimension n, notice 
that we have not ruled out the possibility that some components of v, 
x, and/or y have no effect on the system, and, similarly, that certain of 
the components of w can be ignored. Nonzero initial conditions, if any, 
are assumed to be able to be taken into account either in N or as 
inputs to the system. A signal-flow-graph representation of the rela- 
tions under consideration is given in Fig. 1.* 

In this section, we use Theorem 4 to obtain a result concerning the 
response w of the system to inputs v having sufficiently small norm. 
To state the result, we introduce the following hypotheses and defini- 
tion. 

B.l: The restrictions of A, B, C, and D to Loo(C) are bounded linear 
maps of Loo(C) into itself. 

B.2: There are open neighborhoods Si and S 2 of B in Loc(C) such that 
N restricted to Si is an invertible map of Si onto S 2 . The map N also 
satisfies N(d) = 6. 

* This type of representation of a system has been used in different but related 
settings in Refs. 39, 40, and 41. The maps A, B, C, and D exist for a very large class of 
systems, but it is not difficult to give examples in which one or more map does not exist 
(see Ref. 40, pp. 244-5, for a very simple linear example along these lines). 
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w O- 

(INPUT) N (OUTPUT) 



Fig. 1— Signal flow graph. Fig. 2— Feedback part of the flow graph of Fig. 1. 



Definition: When B.2 holds, the inverse of the restriction of N to Si is 

denoted by O. (Of course, $ maps S 2 onto Si, and we have 0(8) = 6.) 

B.3: There is an open neighborhood S of in Loo(C) such that 

d m Q> exists on S for m = 1, 2, • • • . 

B.4: [d&(0) - Coo] is an invertible map of Loo(C) onto Loo(C), where C. 

is the restriction of C to Loo(C). 

Theorem 6: When B.l, B.2, B.3, and B.4 are met, there is a positive 

number 8 and a neighborhood S of 6 in Loo(C) with the following 

properties: 

(i) For each v e Lco(C) with \\v\\< 8, there exist unique y, x, and w 
ofS, Si, anrfLoo(C), respectively, such that (19), (20), andy = Nx hold. 

(ii) The function w described in (i) is given by 

w = Dv+ £ Bg m (Av) (21) 

for \\v\\< 8, in which gi(Av) = [tfO(0) - Coo] -1 ^, and 
g m (Av) = -[dQ(6) - Coo]" 1 

m 

. X (Z!)" 1 X d%{e)g kl (Av)g k2 (Av) • • • g kl (Av) 

1-2 k l +k 2 +---+k^m 

kj>0 

for m > 2, and the series on the right side of (21) converges uniformly 
for || v || < 8. 

Proof: Using B.4, there are open neighborhoods S and S 3 of in Loo(C), 
with S C S 2 , such that for eachp e S 3 there is in S a unique v with the 
property that &(y) - C^y - P (see Lemma 1). By the boundedness of 
the restriction of A to Loo(C), 6\ > can be chosen so that Av E. S 3 
when v e Loo(C) and || v\\ < 8 U and thus so that for each such v there 
is a unique yES such that $( v) - C^y = Av. For each such v and its 
associate y, let x = 0>( v) and w = Dv + By. Observe that for \\v\\< 8i 
the corresponding triple ( v, x, w) has the properties indicated in (i). 
Now assume, as we may without loss of generality, that S 3 in the 
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preceding paragraph is convex, and that S of B.3 satisfies S C S . 
Choose 88, @ , X, U, and /, respectively, of Section 2.1 to be Loc(C), 
Lco(C), S, S 3 , and the map defined by f(s) = $(s) - C^s for s G S. We 
have df=d$>- C„ on X, d m f = cTO for m = 2, 3, • • • on X, and, by 
B.4, df(6) is an invertible map. Thus, by Theorem 4, there is a a > 
such that S 3 contains an open ball centered at 6 of radius a, and the 
solution s G S of $(s) - C„s = p for p G Loo(C) with ||p|| < a is given 
by the uniformly convergent series 

t Smip), 

m-\ 

in which gi(p) = [d<&(6) — C«J -1 p, and where 

m 

g m (p) = -[cW) - a]" 1 2 (/I)" 1 2 d^(d)g kl (p) . . . ft| (p) 

/-2 *, +A 2 + . . . +kf=m 

kj>0 

for m > 2. Therefore, («') of Theorem 6 holds if for some S G (0, Si) we 
have || At; || < a whenever || v\\ < 8, and this condition is met because by 
B.l the restriction of A to L„(C) is bounded. [Notice that here, and 
with regard to the uniform convergence of the series, we also use the 
boundedness of the restriction of B to Loo(C).] 

3.5 Volterra-sehes representations 

In this, our final section, we first consider the single-input case in 
which v in Theorem 6 satisfies [v(t)]i = for t > and i > 1. We give 
a theorem which provides explicit conditions on A, B, C, D, and N 
under which the hypotheses of Theorem 6 are met and the series for 
w can be interpreted as a Volterra series in V\ the function on [0, 00) 
whose values are [v(t)]i. Towards the end of the section, an n-input 
extension of our result is given. 

We will use the following definitions and hypotheses. 
Definition: For any positive integers / and q, let Sj denote the set of 
all functions h from the Z-dimensional interval [0, oo)' into the set of 
complex n X q matrices such that each hy is measurable and bounded 
on [0, 00) \ and satisfies 

I hij(T h T 2 , • • • , Ti) I d(T U T 2 , • • • , T;) < 00. (22) 

[0.00)' 

Definition: If r and s are two complex column n-vectors, then rs 
denotes the column n- vector defined by {rs)i = nsi for i — 1, 2, • • • , n. 
Definition: (l) L„(C) denotes L„(C) with n - 1. 

C.l: Referring to A, B, C, and D of (19) and (20), there are elements 
a, b, c, and d of Si 1 ' such that for each/) G L«,(C), 
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(Ap)(t)= a(t-T)p(T)dr 



(Bp)(t) = b(t - r)p(T)dT 
Jo 

(C P )(t)= c(t-T) P (T)dT 

Jo 



= I d(t- 

Jo 



(Dp)(t)= | d{t-r)p{r)dr 

for t > 0. 

C.2: For some y > 0, N of Section 3.4 is defined on T = {sG Loo(C): 

l|s||<y}by 

[(Ns)(t)l = nj{[s(t)]j}, t>0 (23) 

for j = 1, 2, • • • , n, in which each »/ maps complex numbers z with 
|z| < y into complex numbers such that n y (0) = and such that 
dnj(z)/dz exists for | z \ < y and is nonzero at z = 0. (Clearly, when C.2 
is met, N restricted to T can be represented by n single-input single- 
output memoryless nonlinear operators.) 

C.3: det{l„ - diag[dni(0)Afe, • • • , dn n (0)/dz] J? c(r)e-"dr} ¥> for 
Re(z) > 0.* 

A result (see Lemma 3, below) concerning elements of Si that we 
shall use is the following: 
Proposition 6: Ifki e Si* for some I, then the iterated integral 

... kl(t - Tl, t - T 2 , • • • , t - T/)/x(ti)/x(t 2 ) • • • ll(Tl)dTidT2 • • ■ dll 

Jo Jo 

exists fort>0 and \l G (1) L.(C), and V*>) defined on [0, oo) by 

V kl (n)(t) = | ••• kl{t-Tl,t-T 2 ,">,t-Tl)\L(Tx)lL{T2) 

Jo Jo 

• • • n(Tt)dTidT 2 • • • dn 

for an arbitrary p. G U) Loo(C), is an element of LUC). 
Theorem 7: Suppose that C.l, C.2, and C.3 are met. Then 

(i) The hypotheses of Theorem 6 are satisfied. 

(ii) For each 1=1,2, ■ • • there is akiES^ such that, under the 
condition that [v(t)]i = 0fort>0 and i > 1, we have 



* As in Section 3.3, 1„ denotes the identity matrix of order n. 
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w= £ V k ,(vi) for \\v\\<8, 
/-i 

with the series uniformly convergent for \\v\\ < 8, where v, w, and 8 
are described in Theorem 6, and Vk, ( • ) is as indicated in Proposition 
6. 

(Hi) Each k t can be taken to be continuous* on [0, oo)' when a and 
d are continuous on [0, oo). 

Proof of Theorem 7: Hypothesis B.l is clearly met. Also, with N as 
described in C.2, an easy modification of Proposition 4 shows + that 
dN:L x (C) -* Loo(C) exists on T, and that forp G T and h G L=o(C), 

[dN(p)h](t) - D(t)h(t), t > 0, (24) 

where D(t) = diag{dni[pi(t)]/dz, • • • , rfn„[p„(^)]/c?2}. 

Similarly, an easy modification of Proposition 5 establishes that 
d m N(p) exists forp G T and all m. (Observe that, because z is complex, 
the existence of dnj(z)/dz for each j and |2| < y means that 
the derivatives of each nj of all orders exist for \z\ < y.) Since each 
dnj(z)/dz is not zero at z = 0, and hence each is nonzero throughout 
a neighborhood of z = 0, it is clear that the \dnj(z)/dz\ are bounded 
away from zero on some neighborhood of z = 0. It follows from (24) 
that dN(p) is invertible for p in a neighborhood of 9 in Loo(C). Thus, 
there are open neighborhoods Si and S2 of 6 such that N restricted to 
Si, which we denote by N , is an invertible map of Si onto S 2 and 
d m (No l ) exists throughout S 2 for each m = 1, 2, • • • (see Lemma 1). 
Therefore, B.2 and B.3 are satisfied. 

Let 4 r :S2 — > Si denote No 1 , and notice that ^ satisfies 

for each y and all s in some neighborhood of 0, where nj 1 , defined in 
a neighborhood of the origin of the complex plane, is a local inverse of 
it/. Since each dnj(z)/dz exists throughout a neighborhood of the 
origin, and does not vanish at the origin, we see that for eachy and m, 
d m nj x (z) I dz m exists in a neighborhood of the origin. Therefore, by a 
direct modification of Proposition 5, 

[d m *(0)hi ■ • ■ h m (t)l = d m nj' (0)/dz m fl hji(t) (25) 

y-i 

for t > 0, each m and i, and any hi, h 2 , • • • , h m in L X (C). 

We shall use (25) subsequently. At the moment, concerning ^, 



* Of course, by kt "continuous" we mean that each component of k t is continuous. 

+ Notice that if dnj[z(pj(t) + hj(t)) + (1 - z)pj(t)]/dz exists at a point (a, 0), then 
dnj]B(pj(t) + hj(t)) + (1 - B)pj(t)), with y8 a real variable, exists at/8 = a and the values 
of the two derivatives are the same. 

EXPANSIONS 185 



note merely that [d9(0)T l = dN(0). Since [d*(6) - C„] - 
d*(0){I - [d < ir(d)y 1 C x }, where I is the identity transformation in 
L„(C) and Go is defined in B.4, by C.3 and Lemma 2 below, we see 
that the hypotheses of Theorem 6 are satisfied. 

In Lemma 2 we refer to the following. 
D.l: X G Si 1 ', A denotes the map of L„(C) into itself defined by 

(Ap)(t) = X(t-T)p(T)dr, *>0 
Jo 

for p G L»(C), and, with z a scalar complex variable, A (z) denotes 



f 



X(t)e~ zt dt, Re(z) > 0. 



Lemma 2: Let D.l hold, and suppose that det{l„ - A (2)} ^ for 
Re(z) >: 0. Then 

(i) (I- A) is an invertible map o/L 00 (C) onto itself, 

(ii) there is a k G 8$* such that 



(I-A)- 1 p(t)=p(t)+\ K(t-T)p(r)dr, *>0 

Jo 

/brpGLoo(C), and 

(Hi) ifX is continuous for t > 0, then k can be taken to be con- 
tinuous on [0, 00).* 
Lemma 2 is proved in Appendix D. 

We also need the following two lemmas which are proved in Ap- 
pendices E and F. 

Lemma 3: Suppose that h G S? for some I > 1, that s £S ( n l) , and that 
u is a bounded measurable function from [0, 00) ' into the complex 
numbers. Then _ 

(i) With K defined on (-00, 00)' byh = hon [0, oo) 1 andh = 0„i (the 
zero nxl matrix) otherwise, the function k, defined by 

k(ai, 02, • • ■ , at) - s(r)h(ai - r, ••• ,cn - r)dr 



■1 



for (01, a 2 , • • • , a/) G [0, 00) ', belongs toS{ l) . 
(ii) If his continuous on [0, oo)', then so is k. 
(Hi) The iterated integrals 



I • • • J h(t - ti, 

Jo Jo 



, £ — ti)m(ti, • • • , ri)dri • • • dr/ 



' Part (Hi) is not used in the proof of Theorem 7, and is included because it is useful 
for other purposes. 
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and 

•l rt 



... 

Jo Jo 



k(t — Ti, • • • , t - t/)m(ti, • • • , n)dri • • • dn 
'o Jo 

exist, and are invariant with respect to interchanges of orders of 
integration, for t>0; andp defined by 

pit) = ••• h(t - ti, • • • , t - ti)u(t u ••., Tl )dri • • • dn, t > 



is an element ofL^iC). 
(iv) We have 



I *(* — r) I ••• I Mt-ti, ••• ,t-ti)k(ti, "• ,T/)rfTi ••• 

Jo Jo Jo 

Jo Jo 



dndr 



t rt 

k (t - ti, • • • , t - ti)u(ti, • • • , n)dTi • • • dn, t > 0. 



Lemma 4: If h G Si p) and k G Si 9) , tfien tfie function s, defined* on 
[0, oo)^ by 

S(T1, • • • , T p+9 ) = h(ji, ' • • , Tp)A(T p+ i, • • • , T p+9 ) 

^)r (ti, • • • , r p+q ) G [0, oo) p + ", belongs toSi p+9) . 
We now return to the proof of Theorem 7. 
With v, w, and 8 as in Part (ii) of Theorem 6, we have 

w = Dv+ J B# m (Ai;), H|<8 

m-l 

in which the series converges uniformly, gi(Av) = [d^iO) — CaJ^Av, 
and 

£ m (Ai;) = -[d*(0) - Co]" 1 

m 

• £ (Z!)" 1 J cf»(«)AiUv) • • • gk,(Av), m > 2. 

/-2 A,+A 2 +...+A / -m 

A,>0 

Assume now that [i>(0]« = for t > and i > 1. By Lemma 3, it 
suffices to show that for each m there is a q m G S\ m) such that 



gm(Av)(t) 
•t 

q m (t - Ti, • • • , f - T m )fi(Ti) • • • Vi(T m )dri ■ • • dr m (26) 



Jo Jo 



* See the second definition at the beginning of Section 3.5. 
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for t > and ||v| < 8, and that q m is continuous on [0, oo) m when a is 
continuous on [0, oo). Thus, suppose for the purpose of induction that 
(26) holds with q m as indicated for m = 1, 2, • • • , p for some p > 1. 
Observe that by Lemma 3 and Part (ii) of Lemma 2 the induction 
hypothesis is met for p = 1. 
We have 

g p+1 (Av) = -[<*¥(*) - C„V 

• ( 2? WT* 2 ***<«*»(*») • • • gk,(Av). (27) 

fy>0 

Now let / > 2 be fixed, and let k h • • • , h be any I positive integers 
such that ki + k 2 + • • • + k t = p + 1. By Lemma 4, (25), and Lemma 
3, r defined by 

r(ri, • • • , Tp+i) 

= 9*,(Tl, • • • , TA,)g* 2 (TA 1+ l, • • • , T*,+A 2 ) • ■ • 9*^*,+. . .+*,_ 1+ 1, • ■ • | T p+ i) 

for (ti, • • • , t p+ i) £ [0, oo)" +1 belongs toSl p+1) , and 
d^(9)g kl (Av) • • • g kl (Av)(t) 

= D \ • • • r(t - ti, • • • , t - Tp+i)i;i(Ti) • • • vi(T p+ i)dTi • • • dr p+ i 
Jo Jo 

for « > 0, in which D is the diagonal matrix of order n whose yth 
diagonal element is d l nj l (0)/dz l . Observe that r is continuous on 
[0, oo) p+1 when each q kj is continuous on [0, oo)*>. 

Therefore, using (27), and by Lemmas 2 and 3, there is a Qp+i E 
S[ p+1) , which is continuous on [0, oo) p+1 when a is continuous on 
[0, oo), such that (26) holds with m replaced with (p + 1). This 
completes the proof of the theorem. 

Comments: By Lemma 2 and Proposition 7 (in Appendix G), an 
interpretation of C.3 is simply that the "feedback part" of the graph of 
Fig. 1, shown in Fig. 2, is bounded-input bounded-output stable* when 
C.l and C.2 are met, N is replaced with its linearization dN(0) extended 
in the natural way to all of H(C), and C:H(C) -»• H{C) is defined by 
(Cp)(t) = R c(t- t)p(t)</t, t > for eachp e H(C). 

The ki in Theorem 7 can be taken to be real valued (i.e., to have 



* By this we mean that for each Loo(C) input to the graph of Fig. 2, there is in H (C) 
a unique output, and the output belongs to L„(C). In this case, existence and uniqueness 
of an output in H (C) follows from the hypotheses concerning c via the usual successive 
approximations approach (Ref. 38, Section 1.13). In Fig. 2, / denotes the identity 
transformation in H(C). 
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zero imaginary part) if a, b, c, and d are real valued, and d m nj x (0)/dz m 
is real for all m and/. (It is not difficult to show that \hed m nj l (0)/dz m 
are real when d m n,j(0)/dz m is real for every m and/.) In particular, we 
see that Theorem 7 establishes the existence of a Volterra-series 
expansion for the important corresponding case in which Vi, w, x, and 
y in Fig. 1 are restricted to be real valued, C.l is met, and N (which 
then would be a map between real-valued function spaces) can be 
analytically extended so that C.2 and C.3 are satisfied.* + In this 
connection, Theorem 5 can be used to prove results along the same 
lines as Theorems 6 and 7, but with L„(C) replaced throughout with 
Loo(R). Similarly, Corollary 1 can be used to obtain corresponding pth 
order approximation results under weaker differentiability hypotheses 
concerning N. 
Theorem 6 provides explicit expressions for the g m (Av). For example, 

gl (Av) = [d*(d) - C„T l Av 

g 2 (Av) - -%[«*¥(*) - C„]- 1 rf 2 ^(^){[rf^(l9) - CJ-Ui/} 2 

g 3 (Av) = -[d*($) - C„r 1 d 2 *(0)g 1 (Av)g2(Av) 

- V6[d*(0) - cjr^^mgMv)?, 

and so on. Therefore, assuming merely that we can write down the 
representation of [dty(d) — Co] along the lines of Part (ii) of Lemma 
2, notice that it is not difficult in principle to give an explicit expression 
for any of the ki of Theorem 7. 

Theorem 7 (and Proposition 6) can be extended to cover the case in 
which the restriction that [p(f)]< = for £ > and i > 1 is not met.* 
Specifically, using the results and techniques described in connection 
with the proof of Theorem 7, it is not difficult to prove the follow- 
ing extension in which for each I, xlv( r i)* ' ••» v(ri)} denotes the 
column vector of order n' whose elements are the n l distinct 
products u«,(ti)i; W2 (t2) • • • v Ul (n), corresponding to distinct sequences 
Wii ^2, • • • , w/ with each coy drawn from {1, 2, • • • , n), arranged in an 
arbitrary predetermined order. 



* Observe that this extendability condition is often met. (In particular, polynomial 
nonlinearities frequently arise in locally-valid models, and polynomials in z are entire 
functions.) 

* Theorem 7 bears on problems concerning the transmission of digital signals over 
analog communication channels. Discussions with this writer's colleague, J. Salz, con- 
cerning such problems provided part of the motivation to formulate the system model 
in Section 3.4 and to develop a theorem along the lines of Theorem 7. 

* The case of more than one input is of importance, for example, in connection with 
studies of the effects of initial conditions. Also, straightforward modifications suffice to 
establish corresponding results for the time- discrete case in which t takes values in 
{0,1,2,...}. 
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Theorem 8: Under the hypotheses of Theorem 7, for every I « 
1, 2, • • • there isakiB S%, with ki continuous on [0, oo)' when a and 
d are continuous on [0, a>), such that 
(i) The iterated integral 



r...j- 

Jo Jo 



ki(t - ti, • • • , t - t/JxIXti), • • • , v(T t )]dTi • • • d-n 



exists fort>0 and v G L„(C), and V k ,(v) defined on [0, «) by 
Vk{v)(t) 

= | • • • ki(t - ti, • • • , t - t/) x |>(ti), • • • , v(Ti)]dTi • • • dn 

Jo Jo 

for any v E L„(C) is an element ofL x (C). 

(ii) With V k ,(-) as indicated in (i) above, and with v, w, and 8 as 
described in Theorem 6, the expansion 

w=l V k ,(v) 

converges uniformly for \\v\\< S. 

It is not difficult to verify that Theorems 7 and 8 remain valid if C.l 
is modified to allow a constant multiple (or, more generally, a constant 
n X w-matrix multiple) of the identity operator on H{C) to be added 
toB. 

We do not give here the details of other extensions of Theorem 7,* 
but it is worthwhile to appreciate that in some extensions in which C.l 
is weakened, series representations can arise in which, unless general- 
ized-function kernels are admitted, the terms do not have the form 
normally associated with a Volterra series. Consider, for example, that 
if ti = 1, if A, as well as B, is the identity transformation on H (C), if C 
and D have the representations on Lco(C) given in C.l, and if C.2 and 
C.3 are satisfied with d 2 n^{0)/dz 2 = 2, then the hypotheses of Theo- 
rem 6 are met and the second term in the sum in (21) is a function 
whose values are 



• We leave for another paper results concerning cases in which N can be of a more 
general form, and the restrictions to L-(C) of A, B, C, and D are not necessarily tune 
invariant, and generalized functions may be involved in their representations. Also left 
for a later paper are applications to differential equations. Assuming merely that A, B, 
C, and D are defined on all of H(C) as convolution operators with kernels a, b, c, and d, 
it is a simple corollary of Theorem 8 that there exists a Volterra-senes expansion also 
for the case in which the conditions of Theorem 8 are met, with the exception that the 
dnAz)ldz are not necessarily nonzero at z = 0. More specifically, N can be replaced 
with N plus a multiple /?/ of the identity operator I on H (C), with | /8 1 sufficiently small 
that the four linear parts of the system can be modified accordingly and remain S„ 
convolutions. 
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-p 3 v(t) 2 -2p 2 v(t) j k{t - r)v(T)dr + p 2 I k(t - r)v(r) 2 dr 

Jo Jo 

+ 2p k(t-r)v(r) k(r - Ti)v(Ti)dT!dT 
Jo Jo 

Jo Jo 



+ ( k a (t- Ti, t - T 2 )v(T 1 )v(T 2 )dTidT2, 



in which p is a nonzero constant, k £ S\ 1] and k a E. S?\ 

APPENDIX A 

Proof of Proposition 1 

Let a be real, nonzero, and such that (ro + a) £ A. Then, using the 
linearity of L(ro + a), 

a~ l [L(r + a)e(r + a) — L(ro)e(r )] 

= L(r + o)o-\e{ro + a) - e(r )] + a~\L{r + a) - L(r )]e(r ) 

- L(r )de(r )/dr + [dL(r )/dr]e(r ) + A x (a) + A 2 (a) + A 3 (a) + A^a), 

where 

Aa(a) = L(r ){(J- 1 [c(r + a) - e(r )] - cfe(ro)/c?r]} 

A 2 (<r) = [L(r + a) - L(ro)]{a _1 [e(ro + a) - e(r )] - de(r )/dr) 

As(a) = [L(r + a) - L(r )]rfe(r )/rfr 

A4(a) = {a" 1 [L(r + a) - L(r„)] - rfL(r )/dr}e(r ). 

Since L(ro) is a bounded operator and ||a _1 [e(rb + a) — e(ro)] — 
de(ro)/dr\\ — » as a — * 0, Ai(<j) — > in S as a — * 0. It is clear that A 2 (a), 
Aa(a), and A»(a) approach zero in S as a — * 0. This completes the proof. 

APPENDIX B 

Part of the Proof of Theorem 1 

Let k be any integer such that 1 < k < p, and let Vi(-), v 2 (-), • • • , 
Vk(-) denote k maps from an open subset of (— oo, oo) containing [0, 1] 
into ^o such that each vj( • ) is differentiable on [0, 1]. With / an integer 
such that < / < k - 1, consider d k f[ q($)]ih{fi) • ■ ■ v k -i-i(P)v k -i(P). 
Since d k f[q(fi)] for < < 1 is a Frechet derivative, d"f[ q(0)]Vi(fi) 
• ■ • Vk-i-i(fi) is a bounded linear map from @o into a Banach space S 
for each /? £ [0, 1]. By the version of the chain rule in Ref. 31, p. 173, 
d{d k f[ q(P)]}/d(3 exists for £ [0, 1], and 
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d{d k f[q(/3)]}/dP = d k+l f[q(P)]q {1) (P), P 6 [0, 1]. (28) 

By Proposition 1, (28), and an obvious inductive argument, 
d{d k f[q(P)]v,(P) •■• Vk-i-i(P))/dP exists for p £ [0, 1]. Thus, by 
Proposition 1, d{d k f[ q(P)]vi(P) ■ • • v k -i(P))/dp exists and satisfies 

d{d k f[q(fi)]vi(P) •'• Vk-i(0)}/dP 

-d k f[q(P)]vAP) ••• VH-i-i(fi)[dVk-ffl/tffl 

+ d{d k f[ q(fi)]vi(fi) • • • Vk-i-i(P))/dp v k -i{P) (29) 

for 06 [0,1]. 

By relations (28) and (29), and the fact that df[q(p)]/dp = 
df[q{P)]q il) (P) for < P < 1, we see that an expression E m (P) can be 
given for d m f[ q(P)]/dp m for /? e [0, 1] which depends only on d l f[ q(P)] 
and q {l) (P) for / = 1, 2, ■ ■ • , m. For example, £ 2 (/G) = df[q(P)]q l2) (P) 
+ d 2 f[q(P)]q ll) (P)q (1) (P)- Since df[q(P)]/dp = (u - Uo) for £ [0, 1], 
we see that £ m (/?) = for £ [0, 1]. 

Now consider (5) and (6). Since rf%[g (r)] and d'q (r)/dr l exist at 
r = & with d%[ q (P)] = <*'/[ q(P)] and d l q (r)/dr l = g (/) (0) for r = 
and I = 1, 2, • • • , m, by Proposition 1 and observations similar to those 
of the preceding three paragraphs, we see that, as claimed in Section 
2.2, d m f [ q(r)]/dr m \ r-p exists and that it equals E m (P). 



APPENDIX C 

Proof of Proposition 2 

Under the conditions indicated, dg(uo) exists (and equals L). Thus, 
using f[g(u)] = u for u £ U, and with / the identity operator on @, we 
have df[g(uo)]dg(uo) = /• This shows that df[g(uo)] has a right 

inverse. 

On the other hand, for u £ U with ||u - Oo| < a, #(") - gM = 
Lf[g(u)] - Lf[g(uo)] + R{f[g(u)] - f[g(uo)]} and, thus, 

{/o - Ldf[g(uo)])[g(u) - g(uo)] = R{df[g{uomg{u) - g(uo)] 

+ R^giu) - g(uo)]} + R2[g(u) - g(uo)] (30) 

in which I Q is the identity operator on @ , Ri(h) = o(\\h\\) as \\h\\ -»• 0, 
and, using the boundedness of L, R 2 (h) = o(\\h\\) as || h\\ -> 0. 

Now let v £ ^ be arbitrary. By the continuity of fatg(uo), and the 
openness of X and £/, choose p > so that g(oo) + aw £ X, 
||/[*(wo) + «u] - /[£(ko)]|| < o, and f[g(Uo) + av] <E U for \a\ < 
p. Notice that for each a with |«| < /?, and with w = f[g{uo) + av], 
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we have || u - uq\\ < a, as well as f[g(u)] = f[g(uo) + <xv], and hence* 
g(u) = g(uo) + av. 
Therefore, by (30), 

{To - Ldf[g(uo)])v = cT l R{df[g(uo)]av + Rx(av)) + a-'Rdav) (31) 

for < | a | < /?. Since the right side of (31) approaches as a — * 0, and 
since v is arbitrary, it follows that df[g(uo)] has a left inverse. Since 
df[g(iio)] has both a left inverse and a right inverse, df[g(uo)Y x exists. 
Finally, a standard type of argument shows that {df)~ l exists and is 
continuous throughout some neighborhood of g(uo) when f is contin- 
uously differentiable on a neighborhood of g(ito) (see the proof of 
Corollary 1 and the references given there). 

APPENDIX D 
Proof of Lemma 2 

In the following, we use Li to denote the set of complex-valued 
functions summable over [0, a>). 

For Re(z) > 0, we have [1„ - A(z)]- 1 = M(z){det[l„ - A(z)]}~\ in 
which M is the matrix of transposed cofactors of [1„ — A(z)] if n > 1 
and M = 1 if n = 1. Since X,> e L\ for each i and/, and the convolution 
of any two bounded L x functions belongs to L x and is bounded, it 
follows that there is a q € Li, and an r e 8$*, such that 

det[l„ - A(z)] = 1-1 q(t)e-"dt 

Jo 

M(z)K(z) = J r(t)e~ zt dt 

Jo 

for Re(z) > 0. 

Since det[l n - A(z)] # for Re(z) > 0, it follows (see Ref. 42, pp. 
60-63) that there is an element s of L\ such that 



{det[l„-A(2)]}" 1 = l i | s(T)e-"dT, Re(z)>0. 1 
Thus, k defined by 

K(t) = r(t) + I r(t - T)s(T)dr, t>0 



| r(t- 
Jo 



* Here we use the hypothesis that for each u £ U, there is exactly one x E X such 
that f(x) = u. 

f Notice that when K(z) is rational in z, it is a simple matter to show the existence of 
such an s. 
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belongs to Sj?\ and H(z) given by 

H(z) = J k(t)€-^t, Re(z) > 
Jo 

satisfies H(z) = [1„ - KWT'Mz) for aU Re(z) ^ 0. 

Since [1„ - XwrWz) = A(z) + X(z)[l„ - Afc)]"^*) for 
Re(z) > 0, we have 

K (t) = X(*) + J \(r)K(t - r)dT (32) 



I 

for almost every £ > 0.* 

For an arbitrary/? G Loo(C), let g G L„(C) be defined by 

?(*) - Pit) + I «(' - T)p(T)dT, * > 0. (33) 

Jo 

We have for t > 0, 

q(t) - (Aq)(t) =p(t) +| K(t- t)p(t)<It - X(t - t)/>(t)c?t 
Jo Jo 

- \(t-Ti) K(Ti - T 2 )p(T 2 )dT 2 dTi. 

Jo Jo 



Since 



I X(* - Ti) K(Ti ~ T 2 )p(T 2 )dT 2 dTi 

Jo Jo 

can be expressed as 



a\(a)K(t -P- a)p{P)dadp 
j 



for t > [the justification of the interchange of order of integration 
being provided by Theorems of Fubini and Tonelli (Ref. 43, pp. 137- 
45)], we have, using (32), (7 - A)? = p. Thus, (I - A) maps L„(C) onto 
itself. Similarly, (32) holds with X and k interchanged in the integral, 
and (32) so modified can be used to show (see the proof of Theorem I 
of Ref. 39) that whenever there is a solution q G L„(C) of (I - A)q = 
p withp G Lcc(C), then (33) holds. This establishes Parts (i) and (ii) 
of the lemma. 
Suppose now that X is continuous on [0, oo). Since k 6S1", by Part 



• Equation (32) is a matrix-valued-function version of the usual equation for the 
resolvent kernel. 
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(ti) of Lemma 3, the integral in (32) depends continuously on t for 
t > 0. Thus, by (32), the values of k agree almost everywhere on 
[0, oo ) with those of a continuous function. This completes the proof of 
the lemma. 

APPENDIX E 
Proof of Lemma 3 

Consider k. That each kn is measurable on [0, oo)' and satisfies 

I |*«l(Tl, • • • , Tf) |d(Ti, • • • , T/) < 00 

J[0.»)' 

follows from a direct application of Theorems of Fubini and Tonelli 
(Ref. 43, pp. 137-45). (See the proof in Ref. 44, pp. 99-100, for the I = 
1 case.) Since every s„ is summable over [0, oo), and h is bounded, we 
see that k is bounded. Thus, (i) holds. 

Suppose now that h is continuous on [0, oo)'. Let a m > be given for 
m = 1,2, • • • , I, let 8 m for m = 1, 2, • • • , / be real variables such that 
each (a m + 8 m ) is nonnegative, and let A be defined by 

A(a + 8) = Sij{r)KjMi + b\ - t, . . • , a/ + 8i - t)c?t 



(a + 8) - I 8y 

Jo 



for any i and j. Let y > be given. With b\ and 62 such that 
\hj\(r\, • • • , t/) I < fei and |s,>(t) | < b 2 for (n, • • • , 17) e [0, 00)' and 
t G [0, 00) , choose to G (0, 00) so that 



J tit 



26, j |s«,-(T)|dT<-i Y , 

' T o 



and observe that 
|A(a + «)-A(«)| 

1 r° ~ 

< — y+b 2 \ I hj\(a\ + 81 — t, • • • , ai + 5/ — t) 

- hjiim - t, ••• , ou - t) |rfT. (34) 

Since y is arbitrary, and, by the boundedness and uniform continuity 
of h on compact subsets of [0, 00) ', the value of the integral in (34) can 
be made arbitrarily small by choosing 

m-1 

to be sufficiently small, we see that k is continuous on [0, 00) \ which 
proves («'). 
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Since h(t — ti, ••• , t - ti)u(ti, • • • , 17) and A(* - ti, ••• , t - 
t;) (ti, • • • , 17) are bounded and measurable on (ti, • • • , 17) G [0, t] , 
the multiple integrals 

I k(t - Tl, • • • , t- T/)u(Ti, • • • , Tl)d(Ti, • • • , Tl) 

Jfmt 

and 

k(t - T h > ■ ■ , t - Tl)u(Ti, • • • , Tl)d (Ti, • • • , T/) 



1 



'[0,0' 

exist. Therefore, two repeated [i.e., two (/ - l)-fold] applications of 
Fubini's theorem (Ref. 43, p. 137) show that the iterated integrals in 
(Hi) exist, that each equals the corresponding multiple integral, and 
that each is invariant under changes in the order of integration. Notice 
that the existence of 

I I ••• I M*-ti, ••• ,t-Ti)u(n, ... ,Ti)dn ••• dn dr (35) 

for any t > can be established in essentially the same way. 
Now let/? be defined on [0, 00) by 

Pit)" I •'• h(t-Tu~',t-Tl) 

Jo Jo 

•m(ti, ..-,T/)rfTi ... dn, *>0. (36) 

Since h E Si , and u is bounded on [0, »)', it is clear from the 
relationship between the iterated integral in (36) and the corresponding 
multiple integral thatp is bounded on [0, 00). That/? is measurable on 
[0, 00), is a consequence of the existence of (35) for all t > 0. 

Similarly, again using Fubini's theorem and the fact that a bounded 
measurable function defined on a set E of finite measure is summable 
over E, we have, for any t > 0, 

I 8(t ~ T) I ••• ( h(t- Ti, ••> ,t~ Tl)«(Tl, • • • , Ti)dTi • • • dTidT 

Jo Jo Jo 

= I S(T) .•• h{t~ T - Ti, •>• ,t-T~Tl) 

Jo Jo Jo 

■U(Ti, ••• , Ti)dTi ••• dTidT 

= [ S(T) h(t-T-Ti,'--,t-T-Tl) 

Jo J[0,t]' 
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J\OJ]> Jo 



u(ti, — , Ti)dri - • • dndT 

s(r)h(t — t — Ti, • • • , t — t — n)dj 



'[0,/]' Jo 

«(Ti, ••• , T/)d(Ti, ••• , T/) 

k(t - Ti, • • • , t - T|)m(ti, • • • , T/)c?(ti, • • • , T/) 
[0.0' 

= ••• k(t~ T h ••• ,t-Ti)ll(Ti, >•• ,Ti)dT X ••• dri, 

Jo Jo 

showing that (iv) is met. This completes the proof of the lemma. 

APPENDIX F 
Proof of Lemma 4 

By Fubini's theorem (Ref. 43, p. 137), and the proposition that 
bounded measurable functions on a set E of finite measure are sum- 
mable on E, 

J\hil(Tl, - • • , Tp)kii(T p+ i, • • • , Tp+q) \d(Ti, • • • , Tp+ q ) 
[o,r]<p + 9' 



•L 



\hti(ri, ••• , T p )|rf(Ti, ••• ,t p ) 

/■•)'■ 

\kil(Tp+l, • • • , Tp+q) |rf(T p +i, • • • , Tp+ q ) 
[0,«)9 

for each i and any finite T > 0, from which it is clear that the lemma 
holds. 

APPENDIX G 

On the Necessity of the Condition That Det[1„ - A (z)] ^ for Re(z) > 

Proposition 7: Let D.l (which appears just before Lemma 2) hold. If 

for each q E Loo(C) there is a p £ Loo(C) such that (7 — A)p = q, then 

det[l„ - A(2)] # for Re(z) > 0. 

Proof. 

Since A £ Sn\ by a standard successive approximations approach 
(Ref. 38, Section 1.13), it can be shown that there is an n X n matrix- 
valued function k defined on [0, oo) such that each k# is square 
summable on any finite interval [0, /?], and 



K (t)=\(t)+\ \(T) K (t - T)dT, *>0 (37) 

'0 
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(i.e., and such that (32) is met for t > 0). From (37) and the Schwarz 
inequality, the Ky are bounded on finite intervals. Using Fubini's 
theorem (see the proof of Theorem I of Ref. 39), if (/ - A)p - q with 
q and/? in L„(C), then 



Jo 



p(t)=q(t)+\ K{t - r)q(r)dr, *>0. 
Jo 

Thus, by the hypothesis of the proposition, each »Cy is summable on 
[0, oo). In particular, the Laplace transform S(z) of k, given by 



ff(z)= J K (t)e- Zt dt 

Jo 



exists for all Re(z) > 0. 

We have (/ - A) (J + H)q = q for every q £ L.(C), in which H is the 
convolution transformation defined in Loo(C) in the usual way in terms 
of k. Now let q be given by q(t) = e~ l Ci for t > 0, in which c, is the 
column n- vector whose ith component is unity and all other compo- 
nents are zero. Upon taking the Laplace transform of both sides 
of (7 - A)(I + H)q = q, we find that [1„ - A(z)][l„ + B(z)]d = c, 
for Re(z) > and each i. Therefore, [1„ - A(z)][l„ + S(z)] = 1„ 
for Re(z) > 0, which shows that det[l„ - A(z)] ^ for Re(z) > 0. 
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